UniFuse: Unidirectional Fusion for 360° Panorama Depth Estimation

نویسندگان

چکیده

Learning depth from spherical panoramas is becoming a popular research topic because panorama has full field-of-view of the environment and provides relatively complete description scene. However, applying well-studied CNNs for perspective images to standard representation panoramas, i.e., equirectangular projection, suboptimal, as it becomes distorted towards poles. Another cubemap which distortion-free but discontinued on edges limited in field-of-view. This letter introduces new framework fuse features two projections, unidirectionally feeding only at decoding stage. Unlike recent bidirectional fusion approach operating both encoding stages, our scheme much more efficient. Besides, we also designed effective module scheme. Experiments verify effectiveness proposed strategy module, model achieves state-of-the-art performance four datasets. Additional experiments show that advantages complexity generalization capability.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

360 Panorama Cloning on Sphere

In this paper, we address a novel problem of cloning a patch of the source spherical panoramic image to the target spherical panoramic image, which we call 360◦ panorama cloning. Considering the sphere geometry constraint embedded in spherical panoramic images, we develop a coordinate-based method that directly clones in the spherical domain. Our method neither differentiates the polar regions ...

متن کامل

Virtual 360 Panorama for Remote Inspection

The use of remotely operated robotic systems in security related applications is becoming increasingly popular. However, the direct teleoperation interfaces commonly used today put a large amount of cognitive burden on the operators, thus seriously reducing the efficiency and reliability of these systems. In the context of an adjustable autonomy control architecture meant to relieve operators f...

متن کامل

Snap Angle Prediction for 360$^{\circ}$ Panorama

360◦ panoramas are a rich medium, yet notoriously difficult to visualize in the 2D image plane. We explore how intelligent rotations of a spherical image may enable content-aware projection with fewer perceptible distortions. Whereas existing approaches assume the viewpoint is fixed, intuitively some viewing angles within the sphere preserve high-level objects better than others. To discover th...

متن کامل

Virtual Reality Motion Parallax with the Facebook Surround-360 using a Depth Augmented Stereo Panorama

Recent interest in virtual reality has led to the development of 360-degree media platforms. In general, 360-degree images or videos can be observed using a head-mounted display (HMD) which tracks head position and renders images for each eye with low latency. Three-dimensional scenes can be portrayed by such displays by incorporating depth cues important to human perception of 3D position. Suc...

متن کامل

3D Panorama Generation Using Depth-MapStitching

As the popularization and development of 3D display makes common users easy to experience a solid 3D virtual reality, the demand for virtual reality contents are increasing. In this paper, we propose 3D panorama system using vanishing point locationbased depth map generation method. 3D panorama using depthmap stitching gives an effect that makes users feel staying at real place and looking arou...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE robotics and automation letters

سال: 2021

ISSN: ['2377-3766']

DOI: https://doi.org/10.1109/lra.2021.3058957